Perturbative Interpretation of Adaptive Thouless-Anderson-Palmer Free Energy
نویسندگان
چکیده
In conventional well-known derivation methods for the adaptive Thouless-Anderson-Palmer (TAP) free energy, special assumptions that are difficult to mathematically justify except in some mean-field models, must be made. Here, we present a new adaptive TAP free energy derivation method. Using this derivation technique, without any special assumptions, the adaptive TAP free energy can be simply obtained as a high-temperature expansion of the Gibbs free energy.
منابع مشابه
Training Restricted Boltzmann Machine via the Thouless-Anderson-Palmer free energy
Restricted Boltzmann machines are undirected neural networks which have been shown to be effective in many applications, including serving as initializations for training deep multi-layer neural networks. One of the main reasons for their success is the existence of efficient and practical stochastic algorithms, such as contrastive divergence, for unsupervised training. We propose an alternativ...
متن کاملThouless-Anderson-Palmer Approach to the Spherical p-Spin Spin Glass Model
We analyze the Thouless-Anderson-Palmer (TAP) approach to the spherical
متن کاملOn Supersymmetry Breaking in the Computation of the Complexity
We study the consequences of supersymmetry breaking in the computation of the number of solutions of the Thouless-Anderson-Palmer (TAP) equations. We show that Kurchan argument that proves the vanishing of the prefactor of the Bray and Moore saddle point for the total number of solutions can be extended to solutions at any given free energy. We also provide a new simple argument for the vanishi...
متن کاملTraining Restricted Boltzmann Machines via the Thouless-Anderson-Palmer Free Energy
Marylou Gabrié, Eric W. Tramel and Florent Krzakala 1 Laboratoire de Physique Statistique, UMR 8550 CNRS, Department of Physics, École Normale Supérieure and PSL Research University, Rue Lhomond, 75005 Paris, France 2 International Centre for Fundamental Physics and its interfaces at Ecole normale suprieure, 75005 Paris, France 3 Sorbonne Universits, UPMC Univ Paris 06, UMR 8550, LPS, F-75005, ...
متن کاملTractable approximations for probabilistic models: the adaptive Thouless-Anderson-Palmer mean field approach.
We develop an advanced mean field method for approximating averages in probabilistic data models that is based on the Thouless-Anderson-Palmer (TAP) approach of disorder physics. In contrast to conventional TAP, where the knowledge of the distribution of couplings between the random variables is required, our method adapts to the concrete couplings. We demonstrate the validity of our approach, ...
متن کامل